I did it once, and wouldn't suggest doing it that way to anyone who asked me.
Pretty much anything on the driver side is voo-doo without pulling the engine. I think you'd end up taking vacation time either way, unfortunately - but if I had to do just that turbo again I would pull the engine for it.